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MMS Observatory 




• Magnetospheric Multiscale (MMS) mission is a constellation of four (4) 
identical observatories designed to investigate the fundamental plasma 
physics process of magnetic reconnection in the Earth’s magnetosphere. 

- The Instrument Suite (IS) on each observatory (OBS) consists of 27 instruments for 
plasma composition, fluxes of energetic particles, and electromagnetic fields 

The detectors and charged particle focusing “optics” used for these 
measurements are sensitive to particulate and molecular contamination. 



- Picture of OBS before bagging for Acoustic testing, 

- Uncovered Soiar Arrays and Bay 7 thrusters 

- Meilinex covered IS along with some still red tag covered 


The four observatories were individually 
subjected to thermal vacuum exposures 
in the Naval Research Laboratory’s 
(NRL) Big Blue (BB) refurbished chamber. 
A large clean room was constructed prior 
to TV testing, which helped stage TV 
preparatory activities for each OBS, 
outside the chamber. 

Dry runs with ground support equipment 
(GSE) were completed before actual OBS 
testing commenced. OBS testing started 
in November 2013 and concluded with 
OBS3 in early August 201 4. 
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OBS overview 





Thrusters, 6 each on 
Bay 3 and 


IS Deck (populated) 

GPS antennas (8) 

Arrays (8) 

Flight Passive Ring 

1-inch thick G-10 (nf) 

GSE Ring (nf) 

Star Trackers (2) 

Aeroflex Coil Springs (nf) 
1 inch thick GIO (nf) 

S-Band Antennas (2) 


OSR covered shunts (4) 

Mag Booms, partially stowed(2) 


nf - non-flight 
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Instrument Suite Components 

(View looking from the bottom of the IS deck) 




-Y 



thiruEtET 
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thruster 
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ADP - Axial Double Probe 
AFG - Analog Flux Gate 
Magnetometer (mounted on 
boom) 

ASPOC - Active Spacecraft 

Potential Control 

CEB - Central Electronics Box 

(Fields) 

CIDP - Central Instrument Data 
Processor 

DES - Dual Electron 

Spectrometer 

DFG - Digital Flux Gate 

Magnetometer (mounted on 

boom) 

DIS - Dual Ion Spectrometer 
EDI/GDU- Electron Drift 
Instrument/ Gun Detector Unit 
EIS -Energeticlon 
Spectrometer 

FEEPS - Fly’s Eye Energetic 
Particle Sensors 
HPCA -Hot Plasma 
Composition Analyzer 
IDPU - Instrument Data 
Processing Unit (FPI) 

SCM - Search-Coil 
Magnetometer (mounted on 
boom) 

SDP- Spin-Plane Double Probe 


• IS detect particles and field strengths based on voltage responses. 

— Sensitive to voltage changes and electrostatic fields 

— Instruments utilize microchannel plates (MCP), sensitive to molecular contamination, 
moisture, and conductive particles) and solid state detectors (SSD), sensitive to moisture 

• 20 instruments and sensors shown on IS deck, out of 27 total. 

— Instruments and supporting electronics came from Southwest Research Institute (SwRI), 
University of New Hampshire (UNH), and several other academia institutions 
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Thermal & Project Goals 




• General Environmental Verification Standard (GEVS) requires 4 
compiete cycies at OBS ievei. 

- Thermally test and transition OBS Hot and Cold, after requested Bakeout. 

- Check out operational and survival OBS heaters 

• Use Hamster cage w/Cryopaneis to controi OBS thermaiiy 

- Bar heaters used to tweak temperature control for individual cryopanels. 

- Cryopanels controlled by 4 new DynaVac Thermal Conditioning Units (TCU) 

• Most eiectronic boxes have an A and B-side; needed to perform 
comprehensive tests (CRTs) under vacuum on aii systems 

- Achieve 100 hours of operation time (powered on) in vacuum on each side 

• Speciai tests: 

- Achieve at least 9 hours of IS High Voltage time. 

- Preconditioning OBS hardware/heaters for 4 hour eclipse. 

- Mag Boom deployments (partial) with frangibolt activation. 

- IS door deployments (EIS) 

- Thruster valve operation and firings in hot and cold 
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TV test profile 




• OBS TV order was #2, #1 , #4, and lastly #3. 

• OBS 2 started with a Thermal Balance with balance points, then chamber break 
reconfigure/reset OBS subsystems and GSE, then complete 3 hot and cold 
thermal vacuum cycles. 

- Restarts required another (shortened) bakeout 

• OBS #1 , #4, and #3 had then just 4 TV cycles, as pictured below 

• All observatories included hot and cold thruster fire test and high voltage testing 
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Test Configuration 






• Testing performed at Naval Research Laboratory using “Big Blue” chamber 

- Dedicated cleanroom was built encompassing chamber door and surrounding 
processing area 

• Cold wall test, thermal cycling accomplished using thermal enclosure 
(“Hamster Cage”) 

- 40 cryopanels for 6 thermal zones. TCUs, omega controllers, bar heaters. A lot of 
plumbing, required extensive leak checking. 

- 4 QCMs: 2 viewing IS (Bays 3&6), solar array (Bay 6), S/C vent (bay 2) 



I/S Deck 
contam barrier 



IS Deck Top Ring Instrument 

Cryopanels {qty 8) Cryopanels (qty 4) Cryopanels (qty 8) 


Solar Array Bottom Ring $C Deck Cryopanels 

Cryopanels (qty 8) Cryopanels (qty 4) (qty g) 


Contamination Controi Objectives 


• Complex set of CC objectives: 

- Bakeout and determination of BOL outgassing rates, maintaining molecular 
and particulate cleanliness, maintaining low pressure for H/V testing, 
monitoring thruster firing 

• CC mitigations: 

- Empty chamber precerts followed by dry runs with both “hamster cages” 

- Contam/thermal barrier in HC, to separate IS from solar arrays 

- Dedicated Scavenger Plate (SP) ducted from OBS bus vent 

• Used large chamber “Contam” Plate to retain most everything else 

- Precleaned chamber before pumpdown and installed witness foils 

- Multiple repress cycles during pump down to drive off water vapor: 

• Pumpdown and repress conducted as slow as possible to maintain stable 
environment (50 torr/hr to 200 torr, then 1 00 torr/hr to 500 torr) 

- Outgassing rate validated with 4 Quartz Crystal Microbalances (QCM). 

• Analysis generated goals to validate OBS outgassing rates. 

- 16 Ion gauges (IG) to monitor pressure and also act as instrument sources 

• Needed <1 E-6 Torr for 48 to 72 hours before IS High Voltage testing 

- Monitored thruster firing with Residual Gas Analyzer (RGA) 


Pressure Monitoring 






Utiiized totai of 19 ion gauges 

- Two existing chamber gauges (MKS and ion) 

- One MMS provided gauge installed in chamber wall 

- 8 gauges outside the hamster cage to stimulate FPI DES/DIS 

- 1 gauge inside the HC as source for HPCA 

- 6 gauges inside the HC solely to monitor local pressure 




• Brooks Series 355 ion gauge 

- Compact, small size, durable metal casing 

- 2 filaments, 3 current emission modes (low-vac, med-vac, high-vac) 

- Had 2 sets of IG for each hamster cage (1 5 per cage). 

- Manually controlled by Granville-Phillips Model 358 Micro-Ion controllers 

- Tested temperature response in a separate test, did not find any impact 

• But to be safe, heaters used to maintain IGs above 0°C 


Systems designed to autonomously trigger the High Voltage (HV) safing 
signal for HV instruments at preset pressure levels and remain there until 

manually reset. 
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Data Acquisition 




• TVAC controlled from GSFC, small core team supporting on site at NRL 

• TC, TQCM, and pressure data collected by NRL-developed CDACS 

- Python based GUI control and data acquisition 

- GSFC ASIST used to control spacecraft and obtain S/C and I/S telemetry 

• MMS IT team instrumental in streaming data to GSFC 

- Thin clients allowed access to the same virtual terminal from GSFC or from 
NRL - many CC shifts supported remotely from GSFC 

- Station screenshots posted to 
MMS l&T site every minute, 
allowed for remote monitoring 
during non-critical events (soak, 
waiting for thermal plateau...) 

• CC team developed software 
for parsing CDACS and RGA 
log files 


Having all TC, pressure, and TQCM data collected by the same DAQ greatly 

simplified anomaly investigations 







Test Data 






Chamber pressure response, operating with 1, 2, or 3 
cryopumps, during precert (empty chamber). 
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TV pumpdown curve 



OBSl Pumpdown/Repress 
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Bakeout Phase 




• Why do a Bakeout (BO)? 

- To accelerate water vapor outgassing from OBS and GSE during prep 

- Reducing outgassing from added polymeric and epoxy materials on the OBS 
& GSE that still could outgas harmful chemical species to IS. 

- Allocated 48 hours in test plan, but all TV times were shorter in duration. 

• Flooded CP and SP first. 

• QCMs set to -20C, activated the RGA, and turned on couple IG 

• Once CP and SP < -120C, thermal then began to adjust HC 
cryopanel settings up in 10C increments to 50C. 

- Idea is to have the OBS hotter than the surrounding area 

- Chamber Shrouds were also warmed up, but lagged cryopanels by 1 0C. 
Shrouds only got to 30-40C. 

• Monitored BO with QCM and RGA. 

• QCM goals set based on meeting OGR of ~1E-12 g/cm^/sec. 

- Looked for meeting OCM delta frequency goals and achieving DDF <5 before 
calling it done. 

• Perform 1®* of thruster firings at end of BO 
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Temp (D^g C) 



Bakeout Phase 
Pressure response 

OBSl TVAC Bakeout Phase 



l.OE-04 



-100 


1/10/20140:00 


1/10/20141200 


1/11/20140:00 


1/11/2014 1200 


1/12/20140:00 


l.OE-07 
1/12/20141200 
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Bakeout Phase 
QCM data response 




Delta Frequency response 
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Bakeout Phase 
OBS Outqassinq Rates 




mM, 



QCMs 

Cryopanel 

Location 

OBS2 

Thai 

11/5/13 

2200 

OBS2 TC 
12/4/13 
0600 

OBSI 

1/11/14 

0800 

OBS4 

2/15/14 

0930 

OBS3 

6/29/14 

2340 

parti 

OBS3 

7/16/14 

1700 

part2 

1 

Bay 2 IS 
(near vent) 

2.4E-13 

1. IE-13 

6.1E-13 

4.8E-13 

5.5E-13 

2.3E-13 

2 

Bay 3 IS 
(DIS/DES) 

7.0E-13 

2.4E-13 

1.8E-12 

1.3E-12 

7.5E13 

2.7E-13 

3 

Bay 6 IS 
(near HPCA) 

2.6E-12 

6.6E-13 

2.8E-12 

2.1E-12 

1.3E-12 

4.2E-13 

4 

Bay 6 SA 
(center panel) 

2.6E-13 

1. IE-13 

2.6E-12 

5.8E-12 

1.3E-12 

5.5E-13 


• Outgassing rates (OGR) verified that req’ts were met <1 E-11 g/cm^/sec. 

• Established QCM delta frequency goals to achieve ~1 E-12 g/cm^/sec 
during Bakeout phase. Expected low OGR due to subsystem bakeouts. 

• QCM4 data typically higher due to molecular condensation on colder 
Bottom Cryopanels and then they were warmed up. OGR before warm up, 
always lower. 
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Thruster firing 



• Propulsion group tested response of 4 axial and 8 radial thrusters by firing each for 
~ 50 milliseconds at hot and at cold plateau 

- Tanks filled with GN2 (28 amu) with argon (40 amu) tracer, no hydrazine 

- CC not necessarily concerned from actual gas depositing onto IS surfaces from 
thruster firings but it was “deemed good” being hot biased initially. 

- Main concern with catbed activations - reaches 220C for axial and 1 20C for radial 
thrusters. The localized polymeric and epoxy material could outgas significantly during 
this preparation for thruster firings. 

- Performed with A-side and B-side CDH and PSE ebox activation, separated by 2-3 
hours in TV. 

• Critical to avoid helium and 
purge all prop lines due to 
lack of turbo pump. 

Cryopumps have very limited 
Helium pumping capacity! 

• Prop testing monitored by 
CC with RGA switched to 
pressure vs. time mode 


Pulses corresponding to thruster firing Also monitored Helium 





Thruster firing 

Pressure and TQCM response 



l.OE-04 


l.OE-05 


l.OE-06 


Ion Gauge Reaction During Thruster Firing A&B-side Bakeout Mod 



Leak causes 
pressure spike 


Initial Axial Thrusters 9A, lOA, 11A,12A 
& Bottom Radial Thrusters 1R,2R; 3R, 4R 
had initial pressure effect & then little to 
no effect on the IGs, during 2nd set of firings 


Firing of Radial Thrusters 
5R, 6R, SR requires 
misc Ion Gauges reset 


l.OE-07 
1/11/2014 13:00 


1/11/2014 14:55 


1/11/2014 1651 


1/11/201418:47 


1/11/2014 20:42 
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OBS Thermal Transitions 




• CC Monitoring during thermal transitions critical 

- Desired to maintain <1 E-6 Torr at all time to avoid resetting timer for H/V testing 

• Necessitated slow transition rates and maintaining > -90C 

l.OOE-04 


-20 


l.OOE-05 


l.OOE-06 


-40 


-60 


-80 


-100 
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Ion Gauge response 




lonGaugePressure-Safing.rtplot 

File Edit X-axis Y-Axis Background Resize XlYauto 


r GMT r Log r Legend T Limits 



ION Gauge Pressures 

15 Jan 2014 11:41:13 


Auto-scale 

1.800E-06|— 
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Ion Gauge response 
Hot Plateau to Cold Plateau 



OBSl Trans Hot 4 to Cold 4, Phase 17 


l.OE-05 


l.OE-06 


Ion Gauge Degas Mode beginning of Cold Plat #4, Phase IS 


1 ON_M I G1_P Ft ESSU RE 

1 ON_M I G3_P R ESSU RE 

ION_M IG5_PRESSURE 

ION_M IG7_PRESSURE 

1 ON_M I G9_P R ESSU RE 

1 ON_M I G1 1_PR ESSU RE 

ION_M IG13_PRESSURE 

ION MIG15 PRESSURE 


1 ON_M I G2_P R ESSU RE 

ION_M IG4_PRESSURE 

1 ON_M I G6_P R ESSU RE 

1 ON_M I G8_P R ESSU RE 

1 ON_M I G10_P R ESSU RE 

ION_M IG12_PRESSURE 

ION_MIG14_PR£SSURE 

ION MIG16 PRESSURE 


MIGs 7-15 Pressure 
portion deactivated 
at 16:30 


MIGs 7-15 Pressure 
portion Activated 
at -19:00 


MIGs spiked 
due to degas 



at ~1500 





Hot to Cold takes -20 hours. Began trans at 1/29/ 14 at -1900, 
then by 1/30/14 1500, should have been at cold Plateau & 
thus the beginning of the MIG degas mode 

J I I I I I I I I I I I I I I I I I I L 

1/30/2014 0:00 1/30/2014 6:00 


l.OE-07 -I ^ 

1/29/2014 18:00 


1/30/2014 12:00 


1/30/2014 18:00 
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Pressure (Torr) 


OBS Warmllp in Stages 


Cryopanels & Shrouds During OBSl Ventback 



l.OE-04 


l.OE-05 


1.0E-0& 



l.OE-07 
2/2/2014 15:00 


2/2/2014 21:00 


2/3/2014 3:00 
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2/3/2014 15:00 
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Temperature (d^ C) 



Pressure (Torr) 


OBS1 Thermal cycle 
pressure levels 



MIG 1-6 Pressures (Torr) vs. Time (GMT) 


0.0001 


le-05 


le-06 



MIGlP(Torr) MIG2P(Torr) MIG3P(Torr) MIG4P(Torr) MIG5P(Torr) 


MIG6 P (Torr) 


Started January 9, 2014 
Ended February 2, 2014 

MIGs 1 & 2 external to HC 
MIGs 3-6 are internal to HC 
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0BS3 TV issues 




• Elevated High pressure levels from start of TVac to almost finish! 

• How to remove Helium and Nitrogen from chamber? 

- Performed numerous Cryopump regenerations and even tried cycle purging 

- Eliminated Prop tanks from being the source of either gas 

• No partial pressure gains from Thruster firings and analytically ruled out 

- Backfilled to 100 torr, did NOT reduce Helium 

- Leak checked with Argon, nothing really noticed consistently 

- Backfilled to ambient pressure; installed “cobbled” Turbo Pump setup (Webb) 

• Helium now successfully removed (not by TP though), but now high levels N2 

- Decided to run with all 3 Cryopumps open; held just 1 E-6 torr in Cold Plateau 

- Thermal minimizes temperature changes, minimum Cryopanels to -85C 

• IS team nervously goes forth with HV testing and completes 

- Realized that manual vent valves for CP, QCMs, SP discharge were all 
closed (from leak testing) 

• Opened and relieved back pressure through cryo flex lines, pressure stabilizes.. 

• Until they freeze over. Needed to melt iceball (Tooley with blow torch) 
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other OBS3 TV issues 




• Were we in the clear? Barely, proceeded to settings for Eclipse 

— Preheated OBS, then all Chamber shrouds & cryopanels were flooded w/LN2 

— Momentary large pressure spike to 1 .2E-5 and then all quiet! 

— The Big Freeze appears to seal all the leaks & reseats chamber burst disk 

— Pressure holds <4 E-7 torr for remainder of testing. 

— Other test support apparatus failed during testing as well 

— Solenoids became stuck at various times 

• Initially in checkout with Omega 10, controlling Bottom ring cryopanel, became SP! 

• The later again later when in Cold Plateau #4, PL melts iceball w/torch 

— TCU #3 failed early, middle, and wasn’t used much after that, until Eclipse 

• Trip a circuit breaker, set off alarms, purge line left open during pre-TV checkout 

• Boom (heard at NRL) relief disk burst, in-line supply too fast (5C/min vs. 1 C/min) 

• Found to be a source of N2 leaks, taken off line. Rough pump attached to it for 
days. Thermal uses heater bar control for Solar Array temperature control. 

• Project polled IS and OBS near end of CP#4. Nobody wanted to 
conduct any additional testing (even though pressure issues 
seemed resolved) so the TV test ended without anymore issues. 
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Pressure (Torr) 


OBS3 Thermal cycle 
pressure levels 



MIG 1-6,15 Pressures (Torr) vs. Time (GMT) 



179 

MIGl P (Torr) 


186 

MIG2P(Torr) 


193 

MIG3P(Torr) 


200 

MIG4P(Torr) MIG5P(Torr) 


207 

MIG6 P (Torr) 


214 

MIG15 P (Torr) 


Started June 27, 2014 
Ended July 14, 2014 am Part 1 

Restarted July 14, 2014 pm 
Ended July 31, 2014 Part 2 


MIGs 1 , 2, &1 5 external to HC 
MIGs 3-6 are internal to HC 
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0BS3 Pressure “Relief” 



l.OE-04 


l.OE-05 


1.0E<>6 


1.0E-O7 


l.OE-Oa 


Analog scan mode Partial Pressure change 
DURING Eclipse TEMP SETTINGS 


1.0E-09 



l.OE-10 ^ ^ ^ 

7/23/14-12:00 7/23/14-15:00 7/23/14-13:00 7/23/14-21:00 7/29/14-0:00 7/29/14-3:00 7/29/14-6:00 7/29/14-9:00 7/29/14-12:00 
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Lessons Learned 






• After 4 TV tests, we still didn’t capture every step, recail every 
chamber operating nuance to make the TV tests go 100% smoothly. 

• Very complex setup, tight confines, lots of mechanical and thermal 
hookups required. Leak checked every time, perhaps too much 
Helium used in progress. Consider using Argon as well. 

• Operated TCUs in ambient temperature and still couldn’t detect all 
the connection leaks. Figure better way to detect leaks. 

• Certainly Need vacuum to validate operation of chamber systems 
beforehand; during Dry Runs & precerts. 

• Don’t turn off Observatory heaters too soon. Needed to maintain 
OBS warmer than surrounding panels and GSE. 

• Ion gauges were ideal for protecting IS from exposures to pressure 
spikes during HV operations. 

• Real-time monitoring, shift test logging, and cross training project 
personnel has it’s benefits. 

• Expect to have problems. Have backup safety plans to secure HW. 
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